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Abstract 

A geometric approach to time-dependent optimal control problems is proposed. This 
formulation is based on the Skinner and Rusk formalism for Lagrangian and Hamiltonian 
systems. The corresponding unified formalism developed for optimal control systems allows 
us to formulate geometrically the necessary conditions given by a weak form of Pontryagin's 
Maximum Principle, provided that the differentiability with respect to controls is assumed 
and the space of controls is open. Furthermore, our method is also valid for implicit optimal 
control systems and, in particular, for the so-called descriptor systems (optimal control 
problems including both differential and algebraic equations). 
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1 Introduction 

In 1983 Skinner and Rusk introduced a representation of the dynamics of an autonomous me- 
chanical system which combines the Lagrangian and Hamiltonian features [23]. Briefly in this 
formulation, one starts with a differentiable manifold Q as the configuration space, and the Whit- 
ney sum TQ®T*Q as the evolution space (with canonical projections p\ : TQ®T*Q — ► TQ and 
P2 : TQ © T*Q — > T*Q). Define on TQ T*Q the presymplectic 2-form = pfacj, where u>q 
is the canonical symplectic form on T*Q, and observe that the rank of this presymplectic form 
is everywhere equal to 2n. If the dynamical system under consideration admits a Lagrangian 
description, with Lagrangian L € C°°(TQ), then we obtain a (presymplectic)-Hamiltonian rep- 
resentation on TQ ®T*Q given by the presymplectic 2-form 0, and the Hamiltonian function 
H = {p\, P2) — p\L , where (•, •) denotes the natural pairing between vectors and covectors on 
Q. In this Hamiltonian system the dynamics is given by vector fields X, which are solutions 
to the Hamiltonian equation i(X)Q = dH. If L is regular, then there exists a unique vector 
field X solution to the previous equation, which is tangent to the graph of the Legendre map 
TL: TQ — ► T*Q. In the singular case, it is necessary to develop a constraint algorithm in 
order to find a submanifold (if it exists) where there exists a well-defined dynamical vector field. 

The idea of this formulation was to obtain a common framework for both regular and sin- 
gular dynamics, obtaining simultaneously the Hamiltonian and Lagrangian formulations of the 
dynamics. Over the years, however, Skinner and Rusk's framework was extended in many di- 
rections. For instance, Cantrijn et al [7] extended this formalism for explicit time-dependent 
systems using a jet bundle language; Cortes et al [6] use the Skinner and Rusk formalism to 
consider vakonomic mechanics and the comparison between the solutions of vakonomic and non- 
holonomic mechanics. In [91 [T3"l [2T] the authors developed the Skinner- Rusk model for classical 
field theories. 

Furthermore, the Skinner-Rusk formalism seems to be a natural geometric setting for Pon- 
tryagin's Maximum Principle. In this paper, whose roots are in the developments made in 
[II EJUS], we adapt the Skinner- Rusk formalism to study time-dependent optimal control prob- 
lems. In this way we obtain a geometric version of the Maximum Principle that can be applied 
to a wide range of control systems. For instance, these techniques enables to tackle geometri- 
cally implicit optimal control systems, that is, those where the control equations are implicit. 
In fact, systems of differential-algebraic equations appear frequently in control theory. Usually, 
in the literature, it is assumed that it is possible to rewrite the problem as an explicit system of 
differential equations, perhaps using the algebraic conditions to eliminate some variables, as in 
the case of holonomic constraints. However, in general, a control system is described as a system 
of equations of the type F(t,x,x,u) = 0, where the x's denote the state variables and the u's 
the control variables, and there are some interesting cases where the system is not described by 
the traditional equations x = G(t,x,u). 

The main results of this work can be found in Sections [3] and |3J where we give a general 
method to deal with explicit and implicit systems. As examples, we consider the case of optimal 
control of Lagrangian mechanical systems (see [H [2j El [3] ) and also optimal control for descriptor 
systems |171 I18j. Both examples have significant engineering applications. 

The organization of the paper is as follows: Section [2J is devoted to giving an alternative 
approach of the Skinner-Rusk formalism for time dependent mechanical systems. In Section 3 
we develop the unified formalism for explicit time-dependent optimal control problems giving a 
geometric Pontryagin's Maximum Principle in a weak form, and in Section 4 we do the same 
for implicit optimal control systems. Section 5 is devoted to examples and applications: first 
we study the optimal control of Lagrangian systems with controls; that is, systems defined 
by a Lagrangian and external forces depending on controls [H [2j El H] . These are considered 
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as implicit systems defined by the Euler-Lagrange equations. Second, we analyze a quadratic 
optimal control problem for a descriptor system [17j . We point out the importance of these kinds 
of systems in engineering problems [18] and references therein. Finally, we include an Appendix 
where geometric features about Tulczyjew's operators, contact systems and the Euler-Lagrange 
equations for forced systems are explained. 

All the manifolds are real, second countable and C°°. The maps are assumed to be C°°. Sum 
over repeated indices is understood. 

2 Skinner-Rusk unified formalism for non- autonomous systems 

This formalism is a particular case of the unified formalism for field theories developed in [9] 
and also in |13j . See [7] for an alternative but equivalent approach, and for an extension of 
this formalism to other kinds of more general time-dependent singular differential equations. 

In the jet bundle description of non-autonomous dynamical systems, the configuration bundle 

is tt: E 5- M, where E is a (n + l)-dimensional differentiable manifold endowed with local 

coordinates (t,q l ), and M has as a global coordinate t. The jet bundle of local sections of tt, 
J 1 tt, is the velocity phase space of the system, with natural coordinates (t,q l ,v' 1 ), adapted to 
the bundle tt: E >- R, and natural projections 

tt 1 : JV ^ E , tt 1 : J x tt R . 

A Lagrangian density C G ^(J 1 ^) is a 7r 1 -semibasic 1-form on J tt, and it is usually written 
as C = Ldt, where L G C 00 ^ 1 ^) is the Lagrangian function determined by C. Throughout this 
paper we denote by dt the volume form in R, and its pull-backs to all the manifolds. 

The canonical structure of the bundle J tt allows us to define the Poincare-Cartan forms 
associated with the Lagrangian density C, and then the Euler-Lagrange equations are written 
intrinsically (see [I0l 23J). 

Furthermore, we have the extended momentum phase space T*E, and the restricted momen- 
tum phase space which is defined by J 1 tt* = T*E/tt*T*R. Local coordinates in these manifolds 
are (t,q l ,p,pi) and (t,q l ,pi), respectively. Then, the following natural projections are 

t 1 :J 1 it* ^E , r 1 = vr o t 1 : jV >M , u,: T*E jV , p: T*E *R. 

Let 9 G Q 1 (T*E) and Q = -d@ G f2 2 (T*E) be the canonical forms of T*E whose local 
expressions are 

= pidq 1 + pdt , = dq l A dpi + dt A dp . 

The Hamilton equations can be written intrinsically from these canonical structures (see, for 
instance, [TOl 121 [13 EH E2] ) • 

Now we introduce the geometric framework for the unified Skinner- Rusk formalism for non- 
autonomous systems. We define the extended jet-momentum bundle W and the restricted 
jet-momentum bundle W r 

W = j\ x E T*E , W r = J 1 7TX E J 1 TT* 

with natural coordinates (t, q l ,v l ,p,Pi) and (t,q l ,v l ,pi), respectively. We have the natural sub- 
mersions 



Pl : W J tt , P 2 : W T*E , p E : W E , Pm : W R (1) 

p\: W r -JV , p r 2 : W r *JV , p r E .W r *E , p r R :W r *■ R ■ 
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Note that % o p\ = r o p, o p 2 = p E - In addition, for y G J tt, and p G T*.E, there is also the 
natural projection 

: W » W r 

(y,p) h-> (y, [p]) 

where [p] = /^(p) G J 1 ^*. The bundle W is endowed with the following canonical structures: 

Definition 1 1. The coupling 1-form in W is £/ie p R -semibasic 1-form C G i? 1 (W) defined 
as follows: for every w = (j 1 (/>(i), a) G VV ft/iot is, a G T* ^E) and V G T W W, then 

C(V) = a(T w ^°P R )V). 

2. The canonical 1-form ©yy G f2 1 (W) is the p E -semibasic form defined by 0yv = p^Q- 
The canonical 2-form is fiyy = — d©w = PqQ £ ^ 2 (W). 

Being C a p R -semibasic form, there is C G C°°(W) such that C = Cdt. Note also that fiyv is 
degenerate, its kernel being the /^-vertical vectors; then (W, f&w) i s a presymplectic manifold. 

The local expressions for 0yv, and C are 

©W = Pid<f + pdt , J7w = — dpi A dq 1 - dp A dt , C = (p + piV l )dt . 

Given a Lagrangian density C G J? 1 (J 1 tt), we denote £ = p\L G ^(W), and we can write 
£ = Ldi, with L = p\L G C°°(W). We define a Hamiltonian submanifold 

Wq = {w G W | £(«;) =C(tw)}. 

So, Wo is the submanifold of W defined by the regular constraint function C — L = 0. Observe 
that this function is globally defined in W, using the dynamical data and the geometry. In local 
coordinates this constraint function is 

p + p i v i -L(t,q j ,v j ) = (2) 

and its meaning will be clear when we apply this formalism to Optimal Control problems (see 
Section [3^2]) . The natural imbedding is jq : Wo W, and we have the projections (submersions), 
see diagram ([3]): 

p\: Wo , p° 2 : Wo -T*£ , p° E : W £ , p° s : W >■ K 

which are the restrictions to Wo of the projections (pQ), and 

^ = /xop°: Wo -JV. 

Local coordinates in Wo are (t,q l ,v l ,pi), and we have that 

Pl(Wy,Pi) = (t,5*y) , 3o{t,q\v\pi) = {t,q\v\L-piv\pi) 
p° 2 (t,q\v\pi) = (t,q\pi) , p 2 ) (t,q i ,v i ,Pi) = (t,q i ,L-p i v i ,Pi). 

Proposition 1 Wo is a 1-codimensional p w -transverse submanifold ofW, which is diffeomor- 
phic to W r . 
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(Proof) For every (y,p) € W , we have L(y) = L(y,p) = C(y,p), and 

(Mw jo)(y,p) = A*w(i/>p) = (j/>m(p)) • 

First, /x w o j is injective: let (yi,pi), (2/2, P2) G Wo, then we have 

0"w ° jo)(yi,pi) = O w ° jo)(y2,P2) =>■ (yi,A»(pi)) = (y2,MP2)) ^yi = m, Mpi) = MP2) 

hence L(yi) = L(|/2) = C^yi, Pi) = C'fe, P2)- In a local chart, the third equality gives 

P(Pl) +Pi(Pl)w*(yi) =P(P2) +Pi(P2)^(j/2) 

but ju(pi) = ju(p2) implies that 

Pi(Pl) = f>i([Pl]) =Pi([P2]) =Pi(P2) 

therefore p(pi) = p(p2) and hence pi = P2- 

Second, n> w °j$ is onto, then, if (y, [p]) € W r , there exists (£/, q) G Jo(Wo) such that [q] = [p]. 
In fact, it suffices to take [q] such that, in a local chart of J 1 ^ x e T*E = W 

Pi(q) = Pi([p]) , p(q) = L (y) - pMWiii) ■ 



, , r d 

Finally, since Wo is defined by the constraint function C — L and, as ker uyy* = < — 

[dp 

d - 

locally and — (C — L) = 1, then Wo is /jl w -transversal. ■ 

As a consequence of this result, the submanifold Wo induces a section of the projection fi w , 

h: W r ^W . 

Locally, h is specified by giving the local Hamiltonian function H = —L + PiV l \ that is, 
h(t,q l ,v l ,Pi) = (t,q % ,v l , —H,Pi). In this sense, h is said to be a Hamiltonian section of ji w . 



So we have the following diagram 




(3) 



1^* 



J'tt 



3 Optimal control theory 

3.1 Classical formulation of Pontryagin's Maximum Principle 

In this section we consider non- autonomous optimal control systems. This class of systems are 
determined by the state equations, which are a set of differential equations 



q* =F(t,q j (t),u a (t)), l<i<n, 



(4) 
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where t is time, q J denote the state variables and u a , 1 < a < m, the control inputs of the 
system that must be determined. Prescribing initial conditions of the state variables and fixing 
control inputs we know completely the trajectory of the state variables q 3 {f) (in the sequel, all 
the functions are assumed to be at least C 2 ). The objective is the following: 



Statement 1 (Non-autonomous optimal control problem). Find a C 2 -piecewise smooth curve 
j(t) = (i, (t),u a (t)) and T € M + satisfying the conditions for the state variables at time and 
T, the control equations Q); and minimizing the functional J{~f) = J L(i, q J (t), u a (t)) dt . 



The solutions to this problem are called optimal trajectories. 

The necessary conditions to obtain the solutions to such a problem are provided by Pon- 
tryagin's Maximum Principle for non-autonomous systems. In this case, considering the time 
as another state variable, we have |19j : 



Theorem 1 (Pontryagin's Maximum Principle). If a curve 7 : [0,T] — > M x M n x W 11 , ^(t) = 
(t,q l (t),u a (t)), with ^(O) and^(T) fixed, is an optimal trajectory, then there exist functions p(t) , 
Pi(t), 1 < i <n, verifying: 

It = ^9 l (t),u a (t),p(t), Pi (t)) (5) 
dn ■ 8V 

II = -^,q\t),u a (t),p(t), Pl (t)) (6) 

H(t,q\t),u a (t),p(t), Pi (t)) = maxH{t,q l {t),u a ,p(t), Pi (t)), t E [0,T] (7) 

u a 

and, moreover, 

H{t,q i {t),u a {t),p{t),p l {t)) =0, t€ [0,T] , (8) 

where 

H(t, q\u a ,p, Pi )=p + Pj P {t, q\ u a ) + poHt, q\u a ) 

and po £ {—1, 0}. 



When we are looking for extremal trajectories, which are those satisfying the necessary 
conditions of Theorem dj condition ([7]) is usually replaced by the weaker condition 

^ = |^ = > 1 (9) 

In this weaker form, the Maximum Principle only applies to optimal trajectories with optimal 
controls interior to the control set. 

Remark: An extremal trajectory is called normal if po = —1 and abnormal if po = 0. For the 
sake of simplicity, we only consider normal extremal trajectories, but the necessary conditions 
for abnormal extremals can also be characterized geometrically using the formalism given in 
Section [21 Hence, from now on we will take po = —1. 

An optimal control problem is said to be regular if the following matrix has maximal rank 

fdipA = f d 2 n 

\du b ) \du a du b 

In the following sections we develop a geometric formulation of this Maximum Principle 
in its weak form, similar to the Skinner-Rusk approach to non-autonomous mechanics as was 
explained in Section [2] and references therein. 
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3.2 Unified geometric framework for optimal control theory 

In a global description, we have a fiber bundle structure -k c : C — > E and tt : E >■ R, where 

E is equipped with natural coordinates (t, q l ) and C is the bundle of controls, with coordinates 
(t,q\u a ). 

The state equations can be geometrically described as a smooth map T : C — > J 1 -k such 
that it makes commutative the following diagram 




which means that T is a jet field along n and also along ir . Locally we have J-(t,q l ,u a ) = 
(t,q\P(t,q\u a )). 

Geometrically, we will assume that an optimal control system is determined by the pair 
(L, JF), where L € i? 1 (C) is a vf^-semibasic 1-form, then L = Ldi, with L € C°°(C) representing 
the cost function; and T is the jet field introduced in the above section. 

In this framework, Theorem [1] in its weak form can be restated as: 

Theorem 1 If a curve 7 : I —* C , with 7(0) and j(T) fixed, is an optimal trajectory, then 
there exists a curve T : I — > C x E T*E such that, in a natural coordinate system, F(t) = 
(j(t),p(t),pi(t)) verifies (GJJ, |2JJ, (0j and where H = p + PjT^ + PqL and po S {—1,0}. 

Now, we develop the geometric model of Optimal Control theory according to the Skinner- 
Rusk formulation. 

The graph of the mapping T , Graphs, is a subset of C x E J l n and allows us to define the 
extended and the restricted control-jet-momentum bundles, respectively: 

YJ T = Graphs x E T*E , = Graphs x E J 1 tt* 

which are submanifolds oi C x E W = C x E J 1 ^ x E T*E and C x E W r = C x E J 1 k x e J l n* , 
respectively. 

In and we have natural coordinates (t,q l ,u a ,p,pi) and (t,q t ,u a ,pi), respectively. 
We have the immersions (see diagram (llip ): 

f , W F^ C x E W, i r (t,q\u a ,p,p i ) = (t,q\u a ,T l (t 1 qi,u\),p,p i ) 
if : W r ^Cx E W r , i?(t,q\u a , Pi ) = (t,q\u a ,F(t,qi,u b ), Pl ) , 

and taking the natural projection 

0-W : C x E W W 

we can construct the pullback of the coupling 1-form C and of the forms 6yy and Qyv to W^: 
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see Definition m whose local expressions are: 

C w r = (p + PiJ 71 ^^! ,u a ))dt , Q w t = Pi&q 1 + p&t , VL w t 
Hence, we can draw the diagram 

Id x /i w 



-dpi A dq l - dp A dt . 



C x E W- 



Cx E W r 



HI 




where pf, P2, Mw^) aim a >V,. are natural projections. 

Furthermore we can define the unique function HyyT : — > R by the condition 

where pf : >■ C is another natural projection. This function H w f is locally described as 

H w r(t, q\ u a ,p, Pi ) =p + Pi F(t, qi,u a ) - L(t, q> , u a ) ; (12) 

(compare this expression with ([2])). This is the natural Pontryagin Hamiltonian function as 
appears in Theorem [TJ 

Let Wq be the submanifold of defined by the vanishing of H w t; that is, 

wf = {weW f H w t{w) = 0} . 

In local coordinates, Wq 7 is given by the constraint 

p+p i F i (t,q j ,u a )-Ut,q j ,u a )=0 . 

Observe that, in this way, we recover the condition ([8]). An obvious set of coordinates in is 
(t, q l ,u a ,pi). We denote by Jq : Wq >■ the natural embedding; in local coordinates, 



j£(t,q\u a , Pi ) = (t,q\u a Mt,q 3 ,u b )-p i r(t,q^ U b ),p J ) 



In a similar way to Proposition [IJ we may prove the following: 



Proposition 2 Wq is a 1-codimensional p F -transverse submanifold ofW , diffeomorphic to 

As a consequence, the submanifold Wq induces a section of the projection p wT , 

bF-.W* . (13) 
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Locally, is specified by giving the local Hamiltonian function = PjJ--* — L; that is, 
,q l ,u a ,pi) = (t,q l ,u a ,p = —H T ,pi). The map h T is called a Hamiltonian section of fi 

Thus, we can draw the diagram, where all the projections are natural 



J 1 ^ 




(14) 



1^* 



J L 7T 



Finally we define the forms 

with local expressions 

e w r = pidq* + {TL - p^dt , n w r = -dp i Adq i -d(L-p i F i ) Adt. 

3.3 Optimal Control equations 

Now we are going to establish the dynamical problem for the system (Wjf, Qyvr) and as a 
consequence we obtain a geometrical version of the weak form of the Maximum Principle. 

Proposition 3 Let (L,J~) define a regular optimal control problem, then there exists a subman- 
ifold Wf 7 of Wg 7 and a unique vector field Z € X(Wq) tangent to Wf 7 such that 



[i(Z)fl w ^]\ W T 







i(Z)dt]\ 



1 . 



(15) 



The integral curves T of Z satisfy locally the necessary conditions of Theorem [H 



(Proof) In a natural coordinate system, we have 



Z ^ A*' ^ B a ^ C ^ 
dt dq l du a 1 dpi 
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where f,A l ,B a ,Ci are unknown functions in Wq\ Then, the second equation (|15|) leads to 
/ = 1, and from the first we obtain that 

coefficients in dpi : J* - A i = (16) 
<9IL dJ~3 

coefficients in du a : — »,■ — — = (17) 

du a 1 du a x ' 

coefficients in dq l : — t — Vj-zr—- Q = (18) 

oq l dq l 

coefficients in df : -A 1 —^ + A%^- - B» — + + CJ* = . (19) 

do 1 du a 

Now, if T(t) = (t,q l (t),u a (t),pi(t)) is an integral curve of Z, we have that A 1 = — , B a = —j—, 
r _ dpi 

The Pontryagin Hamiltonian function is Ji = p + piJ- 1 — L. As we are in W^ 7 , condition ([5]), 
= 0, is satisfied. Furthermore, 

• From (fT6l) we deduce that A* = T l \ that is, — — = — — , which are the equations O. 

ere api 



Equations (|17p determine a new set of conditions 



3L dft . , 

Va= d^- Pi d* = d* =0 (20) 

which are equations ©. We assume that they define the new submanifold Wf 7 of Wq 7 . 
We denote by jf : Wf 7 > Wq the natural embedding. 

dp' dl~L 

• From (11811 we completely determine the functions Cj = — — = — tt^> which are the equa- 
tions (jBJ). 

• Finally, using (fT6|) . (fT8j) and (fTT|) it is easy to prove that equations (fT9j) hold identically. 
Furthermore Z must be tangent to Wf 7 , that is, 

Z ^ a) = Z (0) = ° ( ° n ^ 



or, in other words, 



3 2 w d 2 n b d 2 n on o 2 n 



° dtdu a + T dq { du a + B du b du a dq i d Pi du a ^ n W ^ ' ^ 

d 2 H 

However, as the optimal control problem is regular, the matrix , — has maximal rank. Then 

ou b ou a 

the equations ([2 ID determine all the coefficients i? 6 . ■ 



As a direct consequence of this proposition, we state the intrinsic version of Theorem [2j 

Theorem 3 (Geometric weak Pontryagin's Maximum Principle) . If 7 : I — > C is a solution to 
the regular optimal control problem given by (L,J-), then there exists an integral curve of a vector 
field Z 6 ^{Wq), whose projection to C is 7, and such that Z is a solution to the equations 

i(Z)n w g = , i(Z)dt = 1 , 
in a submanifold Wf 7 ofW$, which is given by the condition 
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Note that the conditions fulfilled by the integral curves of Z, satisfying the suitable initial 
conditions, imply that their natural projections on C are 7. 

Remark: In fact, the second equation of (|15|) could be relaxed to the condition 

i(Z)dt + , 

which determines vector fields transversal to ir whose integral curves are equivalent to those 
obtained above, with arbitrary reparametrization. 

Note that, using the implicit function theorem on the equations <p a = 0, we get the functions 
u a = u a {t, q,p)- Therefore, for regular control problems, we can choose local coordinates (t, q l ,Pi) 
on Wf 7 , and is locally a function of these coordinates. 

If the control problem is not regular, then one has to implement a constraint algorithm to 
obtain a final constraint submanifold (if it exists) where the vector field Z is tangent (see, 
for instance, [8]). 

Let j\ : Wi — » Wq be the natural embedding, the form ^yyf = (jfY^w^ 1S l° cau y written 

as 

Q W f = -dpi A dq 1 - dH\ W T A dt . 

Hence, for optimal control problems, taking into account the regularity of the matrix (I10p . we 
have the following: 

Proposition 4 If the optimal control problem is regular, then (W^ , fly^r , dt) is a cosymplectic 
manifold, that is, (£\y^) n A dt is a volume form (see f73]/). 

4 Implicit optimal control problems 

4.1 Unified geometric framework for implicit optimal control problems 

The formalism presented in Section 13.21 is valid for a more general class of optimal control 
problems not previously considered from a geometric perspective: optimal control problems 
whose state equations are implicit, that is, 

* a (i, q, q, u) = , 1 < a < s , with dl' 1 A . . . A d^ s + . (22) 

There are several examples of these kinds of optimal control problems, some of them coming 
from engineering applications. In Section [5] we study two specific examples: the descriptor 
systems which appear in electrical engineering and the controlled Lagrangian systems which 
play a relevant role in robotics. 

From a more geometric point of view, we may interpret Equations (|22p as constraint functions 
determining a submanifold Mc of C J 1 ^, with natural embedding j Mc : Mq ^Cxg J l n. 
We will also assume that (tt c x tt 1 ) o j m ° : Mc *» E is a surjective submersion. 

In this situation, the techniques presented in the previous section are still valid. Now the 
implicit optimal control system is determined by the data (L,Mc), where L € i7 1 (Mc) is a 

semibasic form with respect to the projection t m ° : Mc *- K, and hence it can be written as 

L = Ldt, for some L € C°°(Mc). First define the extended control-jet-momentum manifold and 
the restricted control-jet-momentum manifold 



W Mc =M c *e T*E , =M c *e 



M. Barbero-Linan et al, Skinner-Rusk unified formalism. 



13 



which are submanifolds oiCx E W = Cx E J 1 ^ x E T*E and C x E W r = C x E J 1 k x e J 1 ^*, 
respectively. 

We have the canonical immersions (embeddings) 

i Mc : W Mc ^Cx E W , if G : W r Mc c — > C x E W r . 
So we can draw a diagram analogous to (fTTj) replacing the core of the diagram by 

M c 

Pi / \Pl 



where all the projections are natural. 

Now, consider the pullback of the coupling 1-form C and the forms <7 w 0>v an d cr^ySlw to 
W Mc by the map i M ° : W M ° >■ C x E W; that is 



C w m c = (a>v o i Mc )*C , G w m c = (cr w o z Mc )*9 w , O w m c = (aw ° i Mc )*n 



>v 



and denote by C £ C°°(W Mc ) the unique function such that C w m c = Cdt. Finally, let H w m c : 

yyM c ^ un iq Ue function such that CyyM C — (pf f °)*L = /iyyA/cdt. Observe that 

HyyM c = C — L, where L = (/9^ //c )*L, and remember that Hy^M c is the Pontryagin Hamiltonian 
function, see (TT2l. 



Let Wq^ be the submanifold of W M ° defined by the vanishing of Hy^M c , i.e. 

Wq Ic = {w£ W Mc | H w m c (w) = (C- L)(» = 0} , (23) 

and denote by jff° : W^ c W Mc the natural embedding. As in Proposition Q] we may prove 
the following: 

Proposition 5 Wq Ic is a l-codimensional Hy^M c -transverse submanifold of W Mc , diffeomor- 
phic to W^c . 

As a consequence, the submanifold Wq induces a section of the projection ^ Mc , 

h M c ■ y\? M c j_ yy M c 

Then we can draw the following diagram, which is analogous to (114j) . where all the projections 
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are natural 



C x e J 1 ^ 



n 0M c 




rMc 
Pi 



1^* 



J L 7T 



Finally, we define the forms 



4.2 Optimal Control equations 

Now, we will see how the dynamics of the optimal control problem (L, Mq) is determined by 
the solutions (where they exist) of the equations 



i{Z)n w M C = , i(Z)dt = 1 , for Z E X{Wq C ) 



(24) 



As in Section 13.31 , the second equation of ([24"]) can be relaxed to the condition 

i(Z)dt ^ . 

In order to work in local coordinates we need the following proposition, whose proof is 
obvious: 

Proposition 6 For a given w G VV ° , the following conditions are equivalent: 
1. There exists a vector Z w € T^Wq^ verifying that 



^ w M c( Z w,Y w ) = , for every Y w G T W W c 



2. There exists a vector Z w &T W (C W) verifying that 
(i) Z w G T W W™°, 
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(ii) i(Z w )(a^Q w ) w G {T w W A Q lc f . 

As a consequence of this last proposition, we can obtain the implicit optimal control equations 
using condition 2 as follows: there exists Z G X(C x e W) such that 

(i) Z is tangent to W^ c . 

(ii) The 1-form i{Z)a^VLy^ is null on the vector fields tangent to Wq /c . 

As Wq /c is defined in (|23p . and the constraints are = and C — L = 0; then there exist 
A a , A G C°°(C x # W), to be determined, such that 

(i(Z)a* w n w )\ w M c = (A Q d* Q + Xd(C - L))| w m c . 

As usual, the undetermined functions A a 's and A are called Lagrange multipliers. 
Now using coordinates (t, q l , u a , in C x e W, we look for a vector field 

d d d d d d 

g _ |_ i j^a _|_ (ji __ _j_ £).___ _|_ 

dt dq' 1 du a dv l 1 dpi dp ' 

where ^4* , -B a ,C l ,D{,E are unknown functions in verifying the equation 

= i z (dq i Adpi + dtAdp) - X a d^ a - Xd(p + py -]L(t,q,u)) 

+ " ~dvF ) du + (" Ak " ~dv^ ) dV 

+(A* - \v*)dpi + (1 - A)dp . 

Thus, we obtain A = 1, and 

A i _ i _ 5L \ ^ £ - 9L A — A aL A 

' dq 1 a dq 1 ' dt a dt ' ^* a 9f * ' <9u a a du a 

together with the tangency conditions 



fd^ a d^ a d^ a d^ a 

V "W ° ^ flgl ^ n a Q v i 

= 2(p+fti)'-L(t,g,ji))| m c . 



Therefore the equations of motion are: 

d ( d^ a \ <9L d^ a 

dt V A ° (t) + (*' ?(*).«(*)) " A «(*)-^t(*» q(t),q(t),u(t)) = 

_(t, 9 (t), u (t))-A a (t)— </(*),«(*)) = 

* a (t,q(t),q(t),u(t)) = 

Let Lo = L — X a ^ a be the classical extended Lagrangian for constrained systems. Then these 
last equations are the usual dynamical equations in optimal control obtained by applying the 
Lagrange multipliers method to the constrained variational problem, that is, the Euler-Lagrange 
equations for Lq, the extremum necessary condition at interior points, and the constraints. 
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Remarks: 

• In the particular case that = v J — T 3 = 0, the vector field Z so-obtained is just the 
image of the vector field obtained in Section 13.31 by the Hamiltonian section (|13p , as a 
simple calculation in coordinates shows. 

• Another obvious but significant remark is that we can take Tt k : J k ir >- R (the bundle 

of /c-jets of 7r) instead of it: E *■ R, and hence J k 7t k and T*J k ir instead of J 1 ^ 1 and 

T*E, respectively. These changes allows us to address those optimal control problems 

where we have <& kC : C >■ J k/ ir; that is, we deal with higher-order equations, and their 

solutions must satisfy that ("/(t), j k+1 (TT k o <& kC o 7 )(i)) G M, where M is a submanifold of 

C X J k+1 7T. 



5 Applications and examples 

5.1 Optimal Control of Lagrangian systems with controls 

See Appendix[A]for previous geometric concepts which are needed in this section. For a complete 
study of these systems see H] and references therein. 

Now we provide a definition of a controlled- force, which allows dependence on time, con- 
figuration, velocities and control inputs. In a global description, one assumes a fiber bundle 
structure & 1C : C — ► J 1 tt, where C is the bundle of controls, with coordinates (t, q, v, it). Then 
a controlled-force is a smooth map F : C >■ C n , so that ttji^ o F = $ 1C (see diagram (|3"3|) ). 

In a natural chart, a controlled-force is represented by 

F(t, q, v, u) = Fi(t, q, v, u)(dq l - v l dt) . 

A controlled Lagrangian system is defined as the pair (£, F) which determines an implicit 
control system described by the subset Dc of C Xji^ J 2 it: 

D C = {(c,p)eCx Jln j\\(ild T e c -(7TfrdL)(p) = ((7rlrF)(c)} 
= {(c,p) G C x Jln J\ | £ c (p) = ((tt?)*F)(c)} 
= {(c,p) £Cxji w J\\ (£ c opr 2 -(irl)*Fop n )(c,p) = 0} 

where pr\ and pr 2 are the natural projections from C x ji n J 2 ir onto the factors. In fact, Dc is 
not necessarily a submanifold of C Xj\ n J 2 ir. There are a lot of cases where this does happen. 
In local coordinates 

( d 2 L d 2 L 

D c = {(t,q,v,w,u) eCx Jln j\ —- I ( t ,q,v)w' + ——(t,q,v)v> 

d 2 L dL 

A solution to the controlled Lagrangian system (£, F) is a map 7: R 3- C satisfying that: 

(i) <fr lC 07 = J 1 (7T 1 O $ 1C O 7). 

(ii) (j(t), j 2 {it l o $ 1C o 7 )(t)) G D c , for every t G R. 
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The condition (i) means that <j? ic o 7 is holonomic, and (ii) is the condition (|35|) of Appendix 
IA.31 that is, the Euler-Lagrange equations for the controlled Lagrangian system (£, F). 

Now, consider the map (Id, T) : C x ji n J 2 ir >- C Xji n J 1 ^ 1 , where T: J 2 ir >■ J 1 ^ 1 is 

defined in ([33]) (see Appendix IA.2[) . and let Mq = (Id, T) (Dc) ■ As (Id, T) is an injective map, 
we can identify Dq C C J 2 tt with this subset Mc of C Xji n J 1 ^ 1 . Observe that there is a 
natural projection from Mc to J 1 it. 

If L : Mc >■ M is a cost function, we may consider the implicit optimal control system 

determined by the pair (L,Mc), where L = Ldi, and apply the method developed in Section [H 

Let W Mc = M c Xji n T* JV, and W° = C x Ji7r J 1 ^ 1 x ji n T* J 1 ^. The natural projection 
from W to T*J 1 7r allows us to pull-back the canonical 2-form Qji n to a presymplectic form 



O c € i? 2 (W ). Furthermore, in J 1 ^ 1 x ji w T* J 1 ^ there is the natural coupling form C (see 



Definition [Q) . We denote by C its pull-back to W C . We denote by L and L the pull-back of L 
c 

and L from Mc to W , for the sake of simplicity. 

Then, let Hy^c : W° >■ M. be the unique function such that C — L = H w cdt, whose 

local expression is Hy^c = p + piv % + piW 1 — L, and consider the submanifold Wo = {q € 
W I Hy^c(q) = 0}. The pull-back of H w c to W c is the Pontryagin Hamiltonian, denoted 
by H w m c . 

Finally, the dynamics is in the submanifold wj = W c n W of W , where jf c is 
the natural embedding. Wq /c is endowed with the presymplectic form ^y^M c = {3\ C )*QyjC ■ 

Therefore, the motion is determined by a vector field Z G 3L(Wq Ic ) satisfying the equations 

i(Z)Q W M C = , i(Z)dt = 1 . 

^ .... 

A local chart in W is (t, q l ,v l ,v l ,w l ,u a ,p,pi,pi), where (w l , w l ) and (p,Pi,pi) are the natural 
fiber coordinates in J 1 ^ 1 and T*J 1 -/r, respectively. The manifold W M ° is given locally by the 
2n constraints: 

d 2 L d 2 L d 2 L 

8L St-,/ s 

(p i (t,q i ,v i ,v\w i ,u a ,p,p i ,Pi) = v i -v i = 0, 
and Wo is given by 

4>(t,q\v\v l ,w\u a ,p,pi,pi) = H w c(t,q\v\v\w\u a ,p,pi,pi) = p+piV l +piW l -1L(t,q,v,u) = 0, 
and 

9,—m g = dq 1 A dpi + dt/ A d^ + dt A d(L - p^ 4 - pjW*) . 

Following Proposition El we look for a vector field Z £ X(W°) such that, for every w £ Wq^: 
(i) Z w GT w W Mc , (ii) i(Z w )O w c S (T w W Mc )° , 

or, equivalently 

(i) of c )*(z(^)) = 0, Of )* W)) = 0, (tf a )*(z(<f>)) = 0. 
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(ii) 0f^(i(Z)O_c) = 0. 



w 

Remember that the constraints are (fi = 0, (p % = 0, = 0. 
If Z is given locally by 

d d d - d -■ d d d d-d 

g _ |_ j\i _j_ J^l _|_ j^l _|_ j±i __ _|_ J^a__ _|_ Y)__ _|_ Q.__ _|_ (J.__ 

dt dq l dv l dv l dw l du a dp dpi dpi ' 

then i4 l , »4*, j4\ ^4*, £? a , D, Ci, Ci are unknown functions in iV", such that 

i(Z)O w c = AM<^ + Aid^ + Ad(p + piU* + p i w i - h(t, q, v, u)) 

and Z((fi) = 0, Z((p l ) = and Z(p + piV l + piW l — h(t, q,v,u)) = 0. From these equations we 
obtain 

A = 1 , A i = v i , A i = w i 

Ci = — - \j^£i d = — - -\i , d = — \ id(pj 

dq l dq % ' dv l dv l dt dt 

du a du a ' ^ l i dv^dq 1 ' ^ dv l dvi ^ 

and the tangency conditions 

%*) = ^+^+^+*"^-B^+^^ = (26) 
at ag J cw? dv % dq ) du a dv l dv J 

Z{4>) = Z{p + p i v i +piW i -h(t,q,v,u)) =0 
where the third condition is satisfied identically using the previous equations. 

Assuming that the Lagrangian L is regular, that is, det(Wjj) = det f g^^j j 7^ 0, then from 

equations for pj and p^ in (|25p we obtain explicit values of the Lagrange multipliers A* and Aj. 
Therefore, the remaining equations (|25p are now rewritten as the new set of constraints 

^,g,,,n,p) = — -^=0, (27) 

which corresponds to — = 0. 

du a 

The new compatibility condition is 
Furthermore we assume that 



then, from Equations (|26h and (128D we obtain the remaining components A 1 and B a , and we 
determine completely the vector field Z. 
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The equations of motion for a curve are determined by the system of implicit-differential 
equations: 



Pi(t) 

kit) 
o 





^—(t, q(t),q(t),u(t)) - \ j (t, q(t),q(t),p(t))^j-(t, q(t) , q(t) , q(t) , u(t)) 



dh 
dq 
<9L 



dq 1 



(t,q(t),q{t),u(t))- Pi (t) 



dv l 

-\l(t,q(t),q(t),p(t)) 



dtp 



dv 



l(t,q(t),q(t),q(t),u(t)) + 



8 2 L 
dvidq 



j(t,q(t),q(t)) 



d /dL 



j(t,q(t),q(t)) 



dL 
dq 



j(t,q(t),q(t))-Fi(t,q(t),q(t),u{t)) 



dt \dv 

c?IL dF ■ 

— (t, q(t), q(t), u(t)) - W ij {t, q{t), q (t))pi(t)^(t, q(t), q(t),u(t)) . 



Equation (|31j) is the explicit expression of (|2Tj) . 



du° 



(29) 
(30) 
(31) 



In [I] the authors study optimal control of Lagrangian systems with controls in a more 
restrictive situation using higher-order dynamics, obtaining that the states are determined by a 
set of fourth-order differential equations. First it is necessary to assume that the system is fully 
actuated, that is m = n, and rank(Hjj) = rank ^^f") = n. Moreover, in the sequel we assume 
that the system is affine on controls, that is, 



Fi(t,q,q,u) = Ai(t,q,q) + A^j (t, q, q)u j 



Therefore 



A 



Then from the constraint equations (130p and (|3ip . applying the Implicit Function Theorem, 
we deduce that 



d / dL 



u\t) = u% q(t), q(t), q(t)) = A» - ^-(t, q(t),q(t)) 
Piit) = Hi(t,q(t),q(t))^(t,q(t),q(t),u(t,q(t), q (t),q(t))) 



dL 



dq 



3 (t,q(t),q(t)) -^"(t, ?(*),?(*)) 



where (H{) are the components of the inverse matrix of the regular matrix (W A^j). 



Taking the derivative with respect to time of Equation (|29p . and substituting the value of 
Pi{f) using Equation (f29j) we obtain a fourth-order differential equation depending on the states. 
After some computations we deduce that 

n((t, q(t), q(t))^-^(t, q ( t ),q(t),q(t))^(t) = G*(t, q(t),q(t), q(t), q(t)) . 



Finally, under the assumption that the matrix ^ g u jg u k 
order system of differential equations: 



a 2 L 



is invertible, we obtain a explicit fourth- 



ly 

~d¥ 



(t)=&(t,q(t),q(t),q(t),q(t)) 



5.2 Optimal Control problems for descriptor systems 



See [T7j for the origin and interest of this example. The study of these kinds of systems was 
suggested to us by Professor. A.D. Lewis (Queen's University of Canada). 
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Consider the problem of minimizing the functional 



o 



1 < i < 3, with control equations 

q 2 = q 1 + hu , q 3 
with parameters Oj, hi > and r > 0. 



[ditff + ru 2 ] dt, 



q 2 + b 2 u , = q 3 + & 3 « 



As in the previous section, the geometric framework developed in Section 13.21 is also valid 



for this class of systems. Let E 



with coordinates (t,q l ), and C 



xl 3 xK with 



coordinates (t, q l ,u). The submanifold Mc cCxg J 1 ^ is given by 

M C = {(t,gW,g 3 V I v 2 = q 1 + b 1 u,v 3 = q 2 + b 2 u ,0 = q 3 + b 3 u} . 

The cost function is 

L : C — ► R 



1 



[aiiq 1 ) 2 + 02(? 2 ) 2 + a 3 (q 3 ) 2 + 



TO 



We analyze the dynamics of the implicit optimal control system determined by the pair (L, Mc)- 

Let W Mc = Mc x e T*E and W c = C x E J 1 it x e T*E with coupling form C inherited from 
the natural coupling form in J 1 tt x T*E. Let H w c : W c >■ R be the unique function such 



that C — L = H w cdt, and consider the submanifold Wo = {q G W"^ |if w c(g) = 0}. Finally, the 
dynamics is in the submanifold W™ c = W M ° n W of W c . Locally, 



{(t,q 1 ,q 2 ,q 3 ,v 1 ,v 2 ,v 3 ,u,p,pi,p 2 ,p 3 ) \ v 2 = q l + b\u ,v 3 = q 2 + 6 2 n , 
g 3 + b 3 u = + +p 2 w 2 +p 3 w 3 — L = 0} . 



Therefore, the motion is determined by a vector field Z G j£(W c ) satisfying the Equations 



(|24p . which according to Proposition [6] is equivalent to finding a vector field Z G X(W C ') (if it 
exists): 







dt dq L oq A dq 6 dv 1 ov z dv 6 < )n ''•<• /,n - 







8 



dv 1 







8 



d_ 

du 



d_ 

dpi 



d_ 

'dpi 



8 



dps ' dp 



such that 



i(Z)n w c = Xidiq 1 + biu - v 2 ) + X 2 d(q 2 + b 2 u - v 3 ) + X 3 d(q 3 + b 3 u) + \dH w c , 
Z{q l + bm - v 2 ) = , Z(q 2 + b 2 u - v 3 ) = , Z{q 3 + b 3 u) = , Z(H w c)=0 

where fiyyc G Q 2 {W C ) is the 2-form with local expression 

£l w c = dq 1 A dpi + dg 2 A dp 2 + dq 3 A dp 3 + dt Adp . 



After some straightforward computations, we obtain that 

11 1 A 2 = q 1 + biu , A 3 = q 2 +b 2 u 

E = , = to - bip 2 - b 2 p 3 - 63A3 

C 3 = A 2 + b 2 B 

P2 = Ai 
D 2 = a 2 q 2 - p 3 



A 1 = v 
A = 1 
v 1 + b 1 B 
Pi = 
Di = aiqi -p 2 



C 



= A 6 + 63B 
P3 = A 2 

-D3 = a3<?3 - A3 . 
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We deduce that 



A3 = t-(™ - hP2 ~ b 2 p 3 ) , B = --}-(q 2 + b 2 u) . 
03 »3 



Therefore, the new constraint submanifold Wf fc Wg /c is 

W^ c = {(t,q 1 ,q 2 ,v 1 ,u,p 1 ,p 2 ,p 3 ) I Pi = 0}. 
Consistency of the dynamics implies that 

= Z(pi) =D\ = 01 gi - p 2 • 

Thus, 

= {(t,q 1 ,q 2 ,v 1 ,u,p 2 ,p 3 ) I aigi -p 2 = 0} 
and once again we impose the tangency to the new constraints: 

= Z{axq\ - p 2 ) = aiv 1 - a 2 q 2 + P3 

which implies that 

W 3 Mc = {(t,q 1 ,q 2 ,v\u, P3 ) I a lV l - a 2 q 2 +p 3 = 0} . 
From the compatibility condition 

= Z(aiv 1 - a 2 q 2 +p 3 ) 
and the constraints we determine the remaining component C 1 of Z: 

C 1 = — !— \(a 2 b 3 - aibijq 1 - b 2 a 2 q 2 + (a 2 &i6 3 + 0363 + r)u + b 2 aiv 1 ] . 

Therefore the equations of motion of the optimal control problem are: 

q l (t) = -^-[(a 2 b 3 -a 1 b 1 )q 1 {t)-a 2 b 2 q 2 {t) + (a 2 hb 3 + a 3 b 2 + r)u(t) + a^q 1 {t)] (32) 
a\b 3 

q 2 (t) = 

= q 2 {t) +b 2 u(t) -b 3 u{t). 

From ([3"2l we deduce that 



= — TT 1 , 2 I [(oi&i - tfc&a)? 1 ® + a 2 b 2 q 2 {t) - ai b 2 q l {t) + ai b 3 q\t)] . 

a 2 b±b 3 + a 3 6 3 + r 

This is the result obtained in Miiller [17J, where the optimal feedback control depends on the 
state variables and also on their derivatives (non-casuality) . 

Choosing local coordinates (t, q 1 , q 2 , u 1 ,^) on W™ c , if j 3 : W 3 Mc i — > W c is the canonical 
embedding, then ^ w m c = j^Oyyc is locally written as 

£lyyM c = — aidq 1 A dq 2 + c^fed? A du — a^df 1 A du + dt A dj 3 p , 

where j 3 p : W 3 /c >- R is the function 

j 3 p = -]^ai(q 1 ) 2 - -a 2 (q 2 ) 2 + -(r + a 3 bl)u 2 - a x biq l u - a 2 b 2 q 2 u + aib 2 v 1 u + aigV . 

Obviously, (0^,(14) is a cosymplectic structure on W^ Ic (see Proposition [4]), and there exists 
a unique vector field Z € X(W 3 /c ) satisfying 

i(z)n w M C = 0, i{Z)dt = 1 . 
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6 Conclusions and outlook 

In this paper we have elucidated the geometrical structure of optimal control problems using 
a variation of the Skinner-Rusk formalism for mechanical systems. The geometric framework 
allows us to find the dynamical equations of the problem (equivalent to the Pontryagin Maximum 
Principle for smooth enough problems without boundaries on the space of controls), and to 
describe the submanifold (if it exists) where the solutions of the problem are consistently defined. 
The method admits a nice extension for studying the dynamics of implicit optimal control 
problems with a wide range of applicability. 

One line of future research appears when we combine our geometric method for optimal 
control problems, and the study of the (approximate) solutions to optimal control problems 
involving partial differential equations when we discretize the space domain and consider the 
resultant set of ordinary differential equations (see, for instance, [5] and references therein and 
[14] . for a geometrical description). This resultant system is an optimal control problem, where 
the state equations are, presumably, a very large set of coupled ordinary differential equations. 
Typically, difficulties other than computational ones appear because the system is differential- 
algebraic, and therefore the optimal control problem is a usual one for a descriptor system. 

Moreover, in this paper we have confined ourselves to the geometrical aspects of time- 
dependent optimal control problems. Of course, the techniques are suitable for studying the 
formalism for optimal control problems for partial differential equations in general. 

A Appendix 

A.l Tulczyjew's operators 

Given a differentiable manifold Q and its tangent bundle tq : TQ >■ Q, we consider the 

following operators, introduced by Tulczyjew [25]: first we have It- ft k (Q) — > f2 k ~ 1 (TQ), 
which is defined as follows: for every (p, v) € TQ, a E f2 k (Q), and X\,..., X^-i € X(TQ), 

(i T a)((p,v);X 1 ,. . .,X k -i) = a(p;u,T(p ) „)TQ((Zi)( P)i; )), . . . , T( P] „ ) TQ((X fc _ 1 ) (Pi „ ) )) . 

Then, the so-called total derivative is a map dx- ft k (Q) »- Q k {TQ) defined by 

(It = d o %rp + % rp o d . 

For the case k = 1, using natural coordinates in TQ, the local expression is 

■ dA 

d T a = d T (Ajdq j ) = Ajdv j + v l -^j-dq j . 
A. 2 Some geometrical structures 

Recall that, associated with every jet bundle J 1 ^, we have the contact system, which is a 
subbundle C n of T* J 1 ^ whose fibres at every j l 4>{t) G J lr K are defined as 

= {« G T^W^M I « = (TiW)^ " T i^(*)(^ ° ^WP, P € V; (t) vr}) . 
One may readily see that a local basis for the sections of this bundle is given by {dq l — v l dt}. 
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Now, denote by J 2 tt the bundle of 2-jets of n. This jet bundle is equipped with natural 
coordinates (t,q l ,v' l ,w l ) and canonical projections 

tt 2 : J 2 tt t-J 1 *, tt 2 :J 2 tt *- E , vf 2 : J 2 vr *- R . 

Considering the bundle J 1 ^ 1 , we introduce the canonical injection T: J 2 tt 5- J 1 ^ 1 given by 

T(j 2 m = (j 1 u 1 mt). (33) 

Taking coordinates (t,q\v l ;v\w l ) in J 1 ^ 1 then T(t, q l , v\ w 1 ) = (t, q\ v l ; v l , w 1 ). 
Thus, we have the following diagram 

TJ 1 tt = TR x T(TQ) T*(J 2 it) j¥ = M x T(TQ) 




J 1 i = Rx TQ 




(34) 

where the inclusion i\ is locally given by i\(t, q, v, w) = (t, 1, q, v, v, w). 

Observe that (ir 2 )*T* J x tx can be identified with a subbundle of T* J 2 ir by means of the natural 
injection i: (irf)*T*J l TT *~ T*J 2 7r, defined as follows: for every p G J 2 tt, a G T* 2 ^ J 1 ^, and 

a G T^ J 2 7r, 

(i(p,a))(a) = a(Tj;7r 2 (a)) . 

In the same way, we can identify (vr 2 )*^ as a subbundle of (7r 2 )*T* J 1 ^ by means of i. 

Local bases for the set of sections of the bundles T* J 2 tt J 2 tt, (ir 2 )*T* J 1 ^ ^ J 2 tt, 

and (tt 2 )*C n ^ J 2 tt are (dt, dq l , dv l , dw l ), (dt, dq l , dv l ), and (dq l — v l dt), respectively. 

Incidentally, Sec ( J 2 vr, (vr 2 )*T* J 1 ^) = C°°(J 2 ^) ® c °°(Ji*) (^ 2 )*^ 1 ( J 1 ^), which are the tt 2 - 
semibasic 1-forms in J 2 7r. 

A. 3 Euler-Lagrange equations 

Let C G l7 1 (J 1 7r) be a Lagrangian density and its associated Lagrangian function L G C°°(J 1 7r). 
Observe that 

d T O c G ^(TJV) , z^ T £ G J? 1 ^) , (vr 2 )*dL G Q 1 {J 2 tt) . 

Then, a simple calculation in coordinates shows that i\dxQc — (^iT^L is a section of the bundle 
projection i((Tr 2 )*C n ) >- J 2 ir. 

The Euler-Lagrange equations for this Lagrangian are a system of second order differential 
equations on Q; that is, in implicit form, a submanifold D of J 2 ir determined by: 

D = {p G J 2 vr I (i\d T ® c - K)*dL)(p) = 0} = {p G J 2 vr I f £ (p) = 0} = £ c \d) , 
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where £c = ildr&c — (vr^)*dL. Then, a section </>: R ^ R x Q is a solution to the Lagrangian 

system if, and only if, Im j 2 <p C £^(0). In fact, working in local coordinates, such as 



d T @c 



dL 



dL 



Q v k ^ V ( Qyj V Ljdt+yt g t g vk 



d 2 L 



+ v' 



d 2 L 

dq l dv k 



d 2 L 

dv l dv k 



dq k 



dL 



I vH -—\+ v i (v j Q2Jj - — ^1 + w i (— + v> 

dtdvi dt J \ dq l dvi dq % ) \dv l dv l dvi dv 



i\d T Qc = 



—dv k + ( + v* &2L + w i ° 2L 

Q v k \dtdv k dq l dv k dv l dv k 



dq k 



d 2 L dL 



+ v l [v 



dL 
dt 



(nfyaL 

we obtain 

i\d T Q c ~ (vr?)*dL 



dtdvi dt 
dL , h dL_ 

dv k 



d 2 L 



dL\ . . d 2 L 

: r r + W V : r 

dq l dvi dq % ) dv % dv^ 



dt 



dt + j- T dq k + —dv k , 
dq K 



d 2 L 

QylQyk 



d 2 L 



v + 



d 2 L dL 





fdL\ 


dL' 


dt 


\dv k ) 


dq k 



dq' l dv k dtdv k dq k 
(dq k - v k dt) . 



(dq k - v k dt) 



dt 



Now, suppose that there are external forces operating on the Lagrangian system ( J 1 ^, £). A 

force depending on velocities is a section F: J x tx ^ C w . As above, the corresponding Euler- 

Lagrange equations are a system of second order differential equations on Q, given in implicit 
form by the submanifold Dp of J 2 it determined by: 

Dp = {p e J 2 vr | {i\d T Q c ~ (7r?)*dL)(p) = (F o 7r?)(p)} = {p£ J 2 vr | £ c (p) = (F o 7rj)(p)} . 

A section <fi : R 5- R x Q is a solution to the Lagrangian system if, and only if, 

ScU 2 <f>) = (*iT[(F°*i)U 2 <f>)] = (^iTFU 1 ^ ■ (35) 



In natural coordinates we have 



f- 


(dL_\ 


dL' 


dt 


ydv k J 


dq k 



(dq k - v k dt) = F j (dq j - v j dt) . 
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